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Abstract 



Lipschitz one-dimensional constrained global optimization (GO) prob- 
f~^ ' lems where both the objective function and constraints can be multiextremal 

00 . and non-differentiable are considered in this paper. Problems, where the con- 

CN ' straints are verified in an a priori given order fixed by the nature of the prob- 

lem are studied. Moreover, if a constraint is not satisfied at a point, then 
t^^ ' the remaining constraints and the objective function can be undefined at this 

^^ , point. The constrained problem is reduced to a discontinuous unconstrained 

problem by the index scheme without introducing additional parameters or 
variables. A new geometric method using adaptive estimates of local Lips- 
chitz constants is introduced. The estimates are calculated by using the local 
k> , tuning technique proposed recently. Numerical experiments show quite a 

;_j ' satisfactory performance of the new method in comparison with the penalty 

approach and a method using a priori given Lipschitz constants. 
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1 Introduction 

It happens often in engineering optimization problems (see |[6j [T2j [151) that the 
objective function and constraints can be multiextremal, non-differentiable, and 
partially defined. The latter means that the constraints are verified in a priori given 
order fixed by the nature of the problem and if a constraint is not satisfied at a 
point, then the remaining constraints and the objective function can be undefined 
at this point. This kind of problems is difficult to solve even in the one-dimensional 
case (see |[T0l[m[T2l[T4l[T5l ). Formally, supposing that both the objective function 
f{x) and constraints gj{x), 1 < j < m, satisfy the Lipschitz condition and the 
feasible region is not empty, this problem can be formulated as follows. 

It is necessary to find a point x* and the corresponding value g^_^_l such that 

9m+i = 9m+i{x*) = mm{gm+i{x) : x G Qm+i}, (1) 

where, in order to unify the description process, the designation gm+i{x) = f{x) 
has been used and regions Qj,l < j < m + 1, are defined by the rules 

Qi = [a,b], Q^+i = {x G Qj : g^{x) < 0}, I <j <m, (2) 

Ql 2 Q2 5 • • • 5 Qm 5 Qm+l- 

Note that since the constraints gj{x), 1 < j < m, are multiextremal, the admissible 
region Qm+i and regions Qj, I < j < m, can be collections of several disjoint 
subregions. We suppose hereafter that all of them consist of intervals of a finite 
length. 

We assume also that the functions gj{x), I < j < m + 1, satisfy the corre- 
sponding Lipschitz conditions 

I gj{x') — gj{x") \< Lj \ x' — x" |, x' , x" £ Qj, 1 < j < m + 1, (3) 

< Lj < 00, 1 < j < m + 1. (4) 

In order to illustrate the problem under consideration and to highlight its dif- 
ference with respect to problems where constraints and the objective function are 
defined over the whole search region, let us consider an example - test problem 
number 6 from IS shown in Figure [T] The problem has two multiextremal con- 
straints and is formulated as follows 

r = fix*) = min{/(x) : giix) < 0,g2{x) < 0,x G [O.l.Svr]}, (5) 

where 
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Figure 1: Problem number 6 from [2| where functions /(x) and gi{x),g2{x) are 
defined over the whole search region [0, 1.5 vr] 
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+ |cos(2(x -7r))| 



(7) 
(8) 



The admissible region of problem ©-([HI) consists of two disjoint subregions shown 
in Figure[T]at the line f{x) = 0; the global minimizer is x* = 3.76984. 

Problem of the type ([T])-© considered in this paper and using the same func- 
tions gi{x)-g2,{x) from ©-dS) is shown in Figure |2] It has the same global mini- 
mizer X* = 3.76984 and is formulated as follows 



Qi = [0,1.5^], Q2 = {x e Qi: gi{x) < 0}, 
Qa = {x E Q2 : 52(2;) < 0}, 



(9) 

(10) 
(11) 



al = gz{x*) = minima (x) : x G Qa}. 

It can be seen from Figure [2] that both g2{x) and /(x) are partially defined: g2{x) 
is defined only over Q2 and the objective function /(x) is defined only over Qa 
which coincides with the admissible region of problem I©-®. 

It is not easy to find a traditional algorithm for solving problem ©-(IHl. For 
example, the penalty approach requires that /(x) and gi{x), 1 < i < m, are 
defined over the whole search interval [a,b]. At first glance it seems that at the 
regions where a function is not defined it can be simply filled in with either a 



Figure 2: Graphical representation of problem (l9l)- (ITTI) 
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big number or the function value at the nearest feasible point. Unfortunately, in the 
context of Lipschitz algorithms, incorporating such ideas can lead to infinitely high 
Lipschitz constants, causing degeneration of the methods and non-applicability of 
the penalty approach. 

A promising approach called the index scheme has been proposed in |fT3l| (see 
also |[Tn[T4l[T5l ) in combination with information stochastic Bayesian algorithms 
for solving problem ([TJ-lIll). An important advantage of the index scheme is that it 
does not introduce additional variables and/or parameters as traditional approaches 
do (see, e.g, ||ll[3l|4l). It has been recently shown in [10] that the index scheme can 
be also successfully used in combination with the Branch-and-Bound approach if 
the Lipschitz constants Lj,l < j < m + 1, from ^, (01) are known a priori. 

However, in practical applications (see, e.g. |61) the Lipschitz constants Lj,l < 
j < m + 1 , are very often unknown. Thus, the problem of their estimating arises 
inevitably. If there exists an additional information allowing us to obtain a priori 
fixed constants Kj,l < j < m + I, such that 



Lj < Kj < oo, 



1 < j < m+ 1, 



then the algorithm IBBA from 1 101 can be used. 

In this paper, the case where there is no any additional information about the 
Lipschitz constants is considered. A new GO Algorithm with Local Tuning (ALT) 
adaptively estimating the local Lipschitz constants during the search is proposed. 
The local tuning technique introduced in fT, "8", '91 for solving unconstrained prob- 
lems allows one to accelerate the search significantly in comparison with the meth- 



ods using estimates of the global Lipschitz constant. The new method ALT unifies 
this approach with the index scheme and geometric ideas allowing one to construct 
auxiliary functions similar to minorants used in the IBBA (see [ 10|). In a series of 
numerical experiments it is shown that usage of adaptive local estimates calculated 
during the search instead of a priori given estimates of global Lipschitz constants 
accelerates the search significantly. 

2 A New Geometric Index Algorithm with Local IVining 

Let us associate with every point of the interval [a, b] an index 

V = v{x), I <v <M, 
which is defined by the conditions 

gj{x) < 0, I <j <u -I, gu{x) > 0, (12) 

where for z^ = m + 1 the last inequality is omitted. We shall call a trial the 
operation of evaluation of the functions (7j (x) , 1 < j < z^(x), at apoint x. 

Thus, the index scheme considers constraints one at a time at every point where 
it has been decided to try to calculate the objective function gm+i{x)- Each con- 
straint gi{x) is evaluated at a point x only if all the inequalities 

gj{x) < 0, I <j <i, 

have been satisfied at this point. In its turn the objective function gm+i{x) is 
computed only for those points where all the constraints have been satisfied. 
Suppose now that A; + 1, A; > 1, trials have been executed at some points 

a = xq < xi < . . . < Xi < . . . < Xk = b (13) 

and the index Vi = v{xi), < i < k, have been calculated following ([12]) . Due 
to the index scheme, the estimate 

zl = mm{gMt.{xi) : < i < k, u{xi) = M''} (14) 

of the minimal value of the function (^^^k (x) found after k iterations can be calcu- 
lated and the values 

, . / 0, if iy{xi)<M>' 

can be associated with the points Xi from (fT3] ). 

In the new algorithm ALT, we propose to adaptively estimate at each iteration 
the local Lipschitz constants over subintervals [xi-i,Xi] C [a,b], 1 < i < k, by 
using the information obtained from executing trials at the points Xi, < i < k, 
from (IT3] ). Particularly, at each point Xj, < i < k, having the index fj we 



calculate a local estimate rji of the Lipschitz constant L^. at a neighborhood of the 
point Xi as follows 

r/i = max{Aj,7i,^}, 0<i<k. (16) 

Here, ^ > is a small number reflecting our supposition that the objective function 
and constraints are not just constants over [a, b], i.e., Lj > ^, 1 < j < m + 1. The 
values Xi are calculated as follows 

maxjl Zj - Zj_i I {xj - Xj-i)"^ : j = i,i + 1}, if v^-i = Vi = Vi+i 

maxjl Zi - Zi_i I (xi -a;j_i)~\ 2^(2:^+1 - x,)"^}, if Vi-i ^ Vi < Vi+i 
max{| Zi+i - Zi I (xj+i -.Xi)"\ Zi{xi - Xi^iy^), if v^^i > u, = ui+i 
max{zi(a;i - x^-i)"^ , Zi{xi+i - x^)"^}, if t^j < i/^-i, j^; < J^i+i 

Zi(xi - Xi^iy^, if i^i-i > i^i > Vi+i 

Zi{xi+i - Xi)'"^, if t^i-i < ^-i < J^i+i 

I 2;* - Zi^l I (2^i - Xi-lY^, if Z^i_l = I^i > J^i+l 

I Zi+i - Zi I {x.,+i - a;i)"\ if z^.j_i < Vi = ui+i 

0, otherwise 

(17) 

where z,, < i < A;, are from (IT5] ). Naturally, when i = or i = /c, only one of 
the two expressions in the first four cases are defined and are used to calculate Aj. 
The values 7i, < i < fc, are calculated in the following way: 

7j = A„,^ max{j;j - Xi_i,Xi+i - Xi}/X^'''', (18) 

A^^ = K^{k) = max{A^^(fc - l),max{Aj : Vj = Ui, 0<j< k}}, (19) 
where A^. are adaptive estimates of the global Lipschitz constants L^. and 

^max _ j^g^jjj^;^. _ Xj-i : Vj = Vi OT Vj-\ = fj, 1 < J < ^j- (20) 

The values Aj and 7^ reflect the influence on r/j of the local and global in- 
formation obtained during the previous iterations. When both intervals [xj_i,Xj] 
and [xj, Xj+i] are small, then 7^ is small too (see (IT8] )) and, due to (IT6l ). the local 
information represented by Aj has major importance. The value Aj is calculated 
by considering the intervals [xj_2,Xj_i], [xj_i,a;i], and [xj,Xj+i] (see (fTTl) ) as 
those which have the strongest influence on the local estimate at the point xi and, 
in general, at the interval [xj_i, Xj]. When at least one of the intervals [xj_i, Xj], 
[xj,Xj+i] is very wide, the local information is not reliable and, due to (IT6l ). the 
global information represented by 7^ has the major influence on r/j. Thus, local 



and global information are balanced in the values r]i, < i < k. Note that the 
method uses the local information over the whole search region [a, b] during the 
global search both for the objective function and constraints. 
We are ready now to describe the new algorithm ALT. 

Step (Initialization). Suppose that A; + 1, A; > 1, trails have been already exe- 
cuted in a way at points 

and their indexes and the value 

M^ = max{u{x') : < i < k} (22) 



have been calculated. The value M^ defined in (l22l) is the maximal index 
obtained during the search after k + 1 trials. The choice of the point x^^^, 
k > 1, where the next trial will be executed is determined by the rules 
presented below. 

Step 1. Renumber the points x^, ....,x^ of the previous k iterations by subscript^j 
in order to form the sequence (IT3] ). 

Step 2. Recalculate the estimate z^ of the minimal value of the function gj^k {x) 
found after k iterations and the values Zi by using formulae (IT4l) and (fTSl ). 
respectively. For each trial point Xj having the index Vi,0<i<k, calculate 
estimate rji from (IT6l ). 

Step 3. For each interval [xj_i, Xj], 1 < i < k, calculate the characteristic of the 
interval 

{( r,,+li,^i ) iVi^i-i + Vi-i^i + rr]i^iT]i{xi-i - Xi)] , u^^i = Vi 
Zi - rr]i{xi - Xj„i - 2;j_i/rr?j_i), Ui^i < i/j 

Zj_i - rrii^i{xi - Xi^i - Zi/rrii), Ui^i > vt 

(23) 
where r > 1 is the reliability parameter of the method (this kind of parame- 
ters is quite traditional in Lipschitz global optimization; discussions related 
to its choice and meaning can be found in ll6l [T2l[T5l ). 

Step 4, Find an interval t corresponding to the minimal characteristic, i.e., 

t = argminj Ri : l<i<k}. (24) 

If the minimal value of the characteristic is attained for several subintervals, 
then the minimal integer satisfying (l24l) is accepted as t. 



'Thus, two numerations are used during the work of the algorithm. The record x^ from J21b 
means that this point has been generated during the i-th iteration of the ALT. The record Xi indicates 
the place of the point in the row ( I13t . Of course, the second enumeration is changed during every 
iteration. 



Step 5. If for the interval [xt-i, xt] , where t is from (l24l) . the stoping rule 

xt - xt^i < £{b- a), (25) 

where a and b are from ([T])-©, is satisfied for a preset accuracy s > 0, then 
Stop - the required accuracy has been reached. In the opposite case, go to 
Step 6. 

Step 6. Execute the {k + l)-th trial at the point 



x 



fc+l ^ f ( r-7;i+rr;i_i ) i^t-1 - Zt + rr]t-lXt^l + riJtXt] , if l^i-l = l^i 

\ 0.5{xt-i+xt), iffj_i/fj, 

(26) 
and evaluate its index i/{x''~^^). 

Step 7. This step consists of the following alternatives: 

Case 1. If ^{x^^^) > M^, then perform two additional trials at the points 

x^+^ = 0.5(xi_.i + x'=+^), x''+^ = 0.5{x''+^ + Xi), (27) 

calculate their indexes, set /c = /c + 3, and go to Step 8. 

Case 2. If u{x^~^^) < M^ and among the points (IT3] ) there exists only one 
point XT with the maximal index Af'^, i.e., ^r = M^, then execute two 
additional trials at the points 

x'^'+2 = o.5(xt-i+3;t), (28) 

x'=+3 = o.5(xT + XT+i), (29) 

if < T < /c, calculate their indexes, set A; = A; + 3, and go to Step 8. If 
T = then the trial is executed only at the point (l29l ). Analogously, HT = k 
then the trial is executed only at the point (|28] ). In these two cases, calculate 
the index of the additional point, set A; = A; + 2 and go to Step 8. 

Case 3. In all the remaining cases set A; = A; + 1 and go to Step 8. 
Step 8. Calculate M'' and go to Step 1. 

Global convergence conditions of the ALT are described by the following two 
theorems given, due to the lack of space, without proofs that can be derived using 
Theorems 2 and 3 from [8J and Theorem 2 from ifTOll . 



Theorem 2.1 Let the feasible region Qm+i ¥" ^ consists of intervals having finite 
lengths, X* be any solution to problem ©-©> cind j = j{k) be the number of 
an interval [xj-i,Xj\ containing this point during the k-th iteration. Then, if for 
k > k* the following conditions 

rK,., > C,_i, rA,^, > Cj, (30) 



Cj-i = Zj^i/{x* -Xj-i), Cj = Zj/{xj -X*). (31) 

take place, then the point x* will be a limit point of the trial sequence {x'^} gener- 
ated by the ALT. 

Theorem 2.2 For any problem ([I])-0 there exists a value r* such that conditions 
([30i are satisfied for all parameters r > r* , where r is from d2JD and \ 



3 Numerical Comparison 

The new algorithm has been numerically compared with the following methods: 

- The method proposed by Pijavskii (see S HI) combined with the penalty ap- 

proach used to reduce the constrained problem to an unconstrained one; this 
method is indicated hereafter as PEN. The Lipschitz constant of the obtained 
unconstrained problem is supposed to be known as it is required by Pijavskii 
algorithm. 

- The method IBB A from ifTOJ using the index scheme in combination with the 

Branch-and-Bound approach and the known Lipschitz constants Lj,l < j < 
m + l, from ©, &. 

Ten non-differentiable test problems introduced in (2] have been used in the 
experiments (since there were several misprints in the original paper [2], the ac- 
curately verified formulae have been applied, which are available at the Web-site 



http://wwwinfo.deis.unical.it/~yaro/constraints.htm]). In this set of tests, problems 1-3 



have one constraint, problems 4-7 two constraints, and problems 8-10 three con- 
strains. 

In these test problems, all constrains and the objective function are defined 
over the whole region [a, b] from Q. These test problems were used because the 
PEN needs this additional information for its work and is not able to solve problem 
©-(Ell- Naturally, the methods IBB A and ALT solved all the problems using the 
statement ©-([111 and did not take benefits from the additional information given 
(see examples from Figures [T] and IS by the statement ©-dD in comparison with 

©-dlB- 

In order to demonstrate the influence of changing the search accuracy e on the 
convergence speed of the methods, two different values of e, namely, e = W~^ 
and e = 10^^ have been used. The same value ^ = 10~^ from (fT6l ) has been used 
in all the experiments for all the methods. 

Table [T] represents the results for the PEN (see ||2l). The constrained problems 
were reduced to the unconstrained ones as follows 

fp,{x) = f{x) + P*m.ayi{0,gi{x),g2{x),... ,gNAx)}- (32) 

The column "Eval." in Table [T] shows the total number of evaluations of the objec- 
tive function /(x) and all the constraints. Thus, it is equal to 

(A^„ + 1) X Ntrials, 

9 



Table 1 : Numerical results obtained by the PEN 
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c — xvJ 

Trials Eval. 



J\f P* 



Trials 
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2 
3 
4 
5 
6 
7 
8 
9 
10 
Av. 



15 
15 
15 
15 
20 
15 
15 
15 
15 
15 




419 


838 


313 


626 


2127 


4254 


861 


2583 


1097 


3291 


6367 


19101 


221 


663 


415 


1660 


4549 


18196 


169 


676 


1653.8 


5188.8 



where Ny is the number of constraints and Nt^ais is the number of the trials exe- 
cuted by the PEN for each problem. 

Results obtained by the IBBA (see 1 10|) and by the new method ALT with the 
parameter r = 1.3 are summarized in Tables|2]and [3l respectively. Columns in the 
tables have the following meaning for each value of the search accuracy e: 

—the column M indicates the problem number; 

—the columns Ng^ , Ng^ , and Ng.^ represent the number of trials where the con- 
straint 5i , 1 < i < 3, was the last evaluated constraint; 

—the column "Trials" is the total number of trial points generated by the meth- 
ods; 

—the column "Eval." is the total number of evaluations of the objective func- 
tion and the constraints. This quantity is equal to: 

—Ng^ + 2 X Nf, for problems with one constraint; 

—Ng^ + 2 X Ng^ + 3 X Nf, for problems with two constraints; 

—Ng^ + 2 X Ng^ + 3 X Ng^ + A X N f , fov problems with three constraints. 

The asterisk in Table [3] indicates that r = 1.3 was not sufficient to find the 
global minimizer of problem 7. The results for this problem in Table [3] are ob- 
tained using the value r = 1.9; the ALT with this value finds the solution. Finally, 
Table |4] represents the improvement (in terms of the number of trials and evalu- 
ations) obtained by the ALT in comparison with the other methods used in the 
experiments. 

As it can be seen from Tables[T]-@l the algorithms IBBA and ALT constructed in 
the framework of the index scheme significantly outperform the traditional method 
PEN. The ALT demonstrates a high improvement in terms of the trials performed 
with respect to the IBBA as well. In particular, the greater the difference between 
estimates of the local Lipschitz constants (for the objective function or for the con- 
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Figure 3: Solving by the method PEN the unconstrained problem (1321) constructed 
from the problem ©-([HI) shown in Figure [T] 
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straints), the higher is the speed up obtained by the ALT (see Table |4l). The im- 
provement is especially high if the global minimizer lies inside of a feasible subre- 
gion with a small (with respect to the global Lipschitz constant) value of the local 
Lipschitz constant as it happens for example for problems 6 and 9. The advantage 
of the new method is more pronounced when the search accuracy e increases (see 
Table II. 

In order to illustrate performance of the methods graphically, in Figures [3]-[5] 
we show dynamic diagrams of the search (with the accuracy e = 10"^ in (l25l) ) 
executed by the PEN, the IBBA, and the ALT, respectively, for problem 6 from ||2l . 
The upper subplot of Figure [3] contains the function fp*{x) from (l32l ) constructed 
from the problem ©-(E]) shown in Figure[T] The upper subplots of Figures |4] and [5] 
contain the index function (see ifTOlfTSll for a detailed discussion) corresponding to 
the problem (l9l)-(fTT]) from Figure |2] Note that the local Lipschitz constant corre- 
sponding to the objective function over this subregion is significantly smaller than 
the global one (see Figures [2] and [S]). 

The line of symbols '-I-' located under the graph of the function (l32l) in Figure[3] 
shows points at which trials have been executed by the PEN. The lower subplots 
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Table 2: Numerical results obtained by the IBBA 
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= 10-^ 






Ng, 
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Eval. 


^^.1 


Ng, 
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Trials 


Eval. 
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23 
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28 


51 


79 


23 
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34 


57 


91 


2 


18 
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16 


34 


50 


20 
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42 
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171 
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19 


190 


209 


175 


— 
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21 


196 


217 


4 


136 


15 
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84 


235 


418 


170 


15 


— 


226 


411 


878 


5 


168 


91 


— 


24 


283 


422 


188 


101 


— 


26 


315 


468 


6 


16 


16 


— 


597 


629 


1839 


17 


17 


— 


2685 


2719 


8106 


7 


63 


18 


— 


39 


120 


216 


65 


19 


— 


43 


127 


232 


8 


29 


11 


3 


21 


64 


144 


29 


14 


3 


23 


69 


158 


9 


8 


86 


57 


183 


334 


1083 


10 


88 


57 


851 


1006 


3761 


10 


42 


3 


17 


13 


75 


151 


42 


3 


17 


15 


77 


159 
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- 
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201.5 


461.1 


- 


- 


- 
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501.9 


1413.4 



Table 3: Numerical results obtained by the ALT with r = 1.3 
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34 
12 
8 
14 



11 
44 
11 
27 
20 
16 
2 



4 
3 

13 



17 
15 
9 
37 
15 
42 
39 
23 
29 
13 



44 


61 


34 


49 


21 


30 


93 


178 


132 


206 


74 


169 


100 


205 


59 


156 


56 


165 


42 


109 


65.5 


132.8 



27 
22 
14 
45 
76 
21 
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38 

24 
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96 
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62 

63 

47 



65 
54 
34 
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215 
235 
228 
164 
193 
129 



72.7 152.8 



Table 4: Improvement obtained by the ALT with r 
other methods used in the experiments 



1.3 in comparison with the 



M 




e = 


10-4 






e = 


10-5 




Trials 


Eval. 


Trials 


Eval 






PEN 
ALl' 


IBBA 

ALl' 


PEN 
ALl' 


IBBA 

ALT 


PEN 
ALl' 


IBBA 

ALl' 


PEN 
ALl' 


IBBA 

ALl' 


1 


5.61 


1.16 


8.10 


1.30 


9.11 


1.24 


12.89 


1.40 


2 


7.09 


1.00 


9.84 


1.02 


8.24 


1.11 


11.59 


1.19 


3 


43.67 


9.05 


61.13 


6.97 


88.63 


8.17 


125.12 


6.38 


4 


2.94 


2.53 


4.60 


2.35 


8.28 


3.95 


12.24 


4.16 


5 


5.08 


2.14 


9.77 


2.0S2 


8.01 


2.30 


15.31 


2.18 


6 


12.28 


8.50 


16.14 


10.88 


66.32 


28.32 


81.28 


34.49 


7* 


1.99 


1.20 


2.91 


1.05 


2.01 


1.15 


2.91 


1.02 


8 


6.19 


1.08 


9.36 


0.92 


6.69 


1.11 


10.12 


0.96 


9 


21.13 


5.96 


28.68 


6.56 


72.21 


15.97 


94.28 


19.49 


10 


3.21 


1.79 


4.95 


1.39 


3.60 


1.64 


5.24 


1.23 


Av. 


10.92 


3.44 


15.55 


3.45 


27.31 


6.50 


37.10 


7.25 



show dynamics of the search. The PEN has executed 909 trials and the number 
of evaluations was equal to 909 x 3 = 2727. In Figure |4] the first line (from up 
to down) of symbols '+', located under the graph of problem (l9l)- (ITTI) . represents 
the points where the first constraint has not been satisfied (number of such trials is 
equal to 16). Thus, due to the decision rule of the IBBA, the second constraint has 
not been evaluated at these points. 

The second line of symbols '+' represents the points where the first constraint 
has been satisfied but the second constraint has been not (number of such trials 
is equal to 16). At these points both constraints have been evaluated but the ob- 
jective function has been not. The last line represents the points where both con- 
straints have been satisfied (number of such trials is 597) and, therefore, the ob- 
jective function has been evaluated too. The total number of evaluations is equal 
to 16 + 16 X 2 + 597 x 3 = 1839. These evaluations have been executed during 
16 + 16 + 597 = 629 trials. 

Similarly, in Figure [5j the first line of symbols '-I-' indicates 21 trial points 
where the first constraint has not been satisfied. The second line represents 11 
points where the first constraint has been satisfied but the second constraint has 
been not. The last line shows 42 points where both constraints have been satisfied 
and the objective function has been evaluated. The total number of evaluations is 
equal to 21 + 11x2 + 42 x3 = 169. These evaluations have been executed during 
21 + 11 + 42 = 74 trials. 
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Figure 4: Solving the problem (l9l)-(fTT]) by the method IBBA 
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Figure 5: Solving the problem (l9l)- (ITTI) by the method ALT with r = 1.3 
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